Nonparametric predictive distributions based on conformal prediction
نویسندگان
چکیده
This paper applies conformal prediction to derive predictive distributions that are valid under a nonparametric assumption. Namely, we introduce and explore predictive distribution functions that always satisfy a natural property of validity in terms of guaranteed coverage for IID observations. The focus is on a prediction algorithm that we call the Least Squares Prediction Machine (LSPM). The LSPM generalizes the classical Dempster Hill predictive distributions to regression problems. If the standard parametric assumptions for Least Squares linear regression hold, the LSPM is as e cient as the Dempster Hill procedure, in a natural sense. And if those parametric assumptions fail, the LSPM is still valid, provided the observations are IID.
منابع مشابه
Shrinkage Priors for Bayesian Prediction
We investigate shrinkage priors for constructing Bayesian predictive distributions. It is shown that there exist shrinkage predictive distributions asymptotically dominating Bayesian predictive distributions based on the Jeffreys prior or other vague priors if the model manifold satisfies some differential geometric conditions. Kullback– Leibler divergence from the true distribution to a predic...
متن کاملModel-free model-fitting and predictive distributions
The problem of prediction is revisited with a view towards going beyond the typical nonparametric setting and reaching a fully model-free environment for predictive inference, i.e., point predictors and predictive intervals. A basic principle of model-free prediction is laid out based on the notion of transforming a given setup into one that is easier to work with, namely i.i.d. or Gaussian. As...
متن کاملFast and Scalable Nonparametric Bayesian Prediction for the M/G/1 Queue
In this article we develop a nonparametric Bayesian approach to prediction for the M/G/1 queue, focusing on the imbedded semiMarkov process of the queue at the departure times. Our approach is motivated by queues with a large number of data points and highfrequency systems, where times consuming MCMC/ABC algorithms might be infeasible and a nonparametric approach is desirable to avoid parametri...
متن کاملDistribution Free Prediction Bands
We study distribution free, nonparametric prediction bands with a special focus on their finite sample behavior. First we investigate and develop different notions of finite sample coverage guarantees. Then we give a new prediction band estimator by combining the idea of “conformal prediction” (Vovk et al., 2009) with nonparametric conditional density estimation. The proposed estimator, called ...
متن کاملEfficient Nonparametric Conformal Prediction Regions
We investigate and extend the conformal prediction method due to Vovk, Gammerman and Shafer (2005) to construct nonparametric prediction regions. These regions have guaranteed distribution free, finite sample coverage, without any assumptions on the distribution or the bandwidth. Explicit convergence rates of the loss function are established for such regions under standard regularity condition...
متن کامل